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Abstract. To study operator algebras with symmetries in a wide sense we 
introduce a notion of relative convolution operators induced by a Lie algebra. 
Relative convolutions recover many important classes of operators, which have 
been already studied (operators of multiplication, usual group convolutions, 
two-sided convolution etc.) and their different combinations. Basic properties 
of relative convolutions are given and a connection with usual convolutions is 
established. 

Presented examples show that relative convolutions provide us with a base 
for systematical applications of harmonic analysis to PDO theory, complex 
and hypercomplex analysis, coherent states, wavelet transform and quantum 
theory. 
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1. Introduction 

Convolution operators and different operators associated with them are very 
important in mathematics (for example, in complex analysis and physics (for 
example, quantum mechanics |21| and [551 Chap. 3]). The fundamental role of 
such operators may be easily explained. Indeed, a notion of symmetries and group 
transforms invariance are the basis of the contemporary science. It is well known, 
that operators, which are invariant under a transitive group operation, may be 
realized as convolution operators on the group. 

However, there are some limitations for an application of convolution operators: 

• It is not a rare case when a operators symmetry group and functions domain 
have different dimensions. 

• Group convolution operators are generated by transformations of function 
domains. However, mathematical objects are often connected not only with 
domain transforms but also with alterations of function range or even both 
of them. 

The paper introduces a notion of relative convolutions, which allows us to overcome 
these limitations. Naturally, such an interesting object cannot be totally unknown 
in mathematics and we will give a short description of connected ones in Remarkl2~2l 
In this paper we work only with continuous groups of symmetry. Discrete groups 
or their mixtures with continuous ones may be also considered. 

A geometric group structure and related objects (especially the non-commutative 
Fourier transform) are obviously determining for properties of convolution algebra. 
If the group structure is used not only as a basis for particular calculations but also 
in a more general framework, then it is possible to find the proper level of generality 
for obtained results 1 . 



See, for example, the deduction of a PDO— form for convolutions on step 2 nilpotent Lie groups 
in 0] P- 9-10] or Theorem IPI 
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Be found, that geometry of Lie groups and algebras jointly with properties of 
kernels determine representations of relative convolution algebras. Namely, all rep- 
resentations of relative convolution algebras will be induced by selected representa- 
tions of corresponding Lie algebras (Lie groups) and the selection of representations 
will depend on kernels properties. The representation theory of Lie algebras is com- 
plicated and still unsolved completely. But, due to the author personal interest, 
the main examples are nilpotent Lie algebras fully described by the Kirillov theory 
(see or Chap. 6]). Considered examples will show that such a restriction 
still leaves enough space for very interesting applications. 

The layout is as follows. 

In SectionElwe give necessary notations, introduce the main object of the paper 
— relative convolution — and show basic examples. Relative convolutions recover 
many important classes of operators, which have been already studied (operators 
of multiplication, usual group convolutions, two-sided convolutions etc.) and their 
different combinations. 

Basic properties of relative convolutions are given in Section We prove a 
formula for the composition of relative convolutions and deduce from it that an 
algebra of relative convolutions induced by a Lie algebra q is a representation of the 
algebra of group convolutions on the Lie group Expg. We also state the universal 
role PDO and the Heisenberg group in the theory of relative convolution operators. 

Relative convolutions provide us with a tool for the systematic usage of harmonic 
analysis in different fields of pure and applied mathematics. This statement will 
be illustrated in Sections 01 and by many examples, which show applications of 
relative convolutions to the theory of PDO, complex and hypercomplex analysis, 
coherent states, wavelets and quantum mechanics. 

In Section [5] we will describe our view on a notion of coherent states. The main 
observation is: a direct employment of group structures of coherent states gives 
us the uniform theory for the Bargmann, Bergman and Szego projectors at the 
Segal-Bargmann (Fock), Bergman and Hardy spaces respectively. Applications to 
wavelets (and other) theory are also possible. 

The author gratefully acknowledge his inspiration by papers |17l 1181 l2"51 1291 151) . 
Besides, there is some interference with the coherent recent paper of Folland |22j . 
The author is also grateful to Dr. V. V. Kravchenko and Prof. N. L. Vasilevski for 
helpful discussions. 



2.1. Definitions and Notations. Let G be a connected simply connected Lie 
group, let g be its finite-dimensional Lie algebra. By the usual way we can identify 
g with M. N for N — dimg as vector spaces. The exponential map exp : g — > G [321 
§ 6.4] identifies the group G and its algebra g. So G as a real C°°-manyfold has 
the dimension N. Let fix a frame {Xj}i<j<N of g. Via the exponential map 
we can write a decomposition g = XjXj in exponential coordinates for every 
g G G. The group law on G in the exponential coordinates may be expressed via 
the Campbell-Hausdorff formula [321 § 6.4]: 



2. Relative Convolutions 



(2.1) 




7£ 



kj>l, lj>l 
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where [xix 2 ■■■x„] = ^ [. . . [[xi , x 2 ] , x 3 ] , . . . , x n ] and 

JV N 

9 = ^2x j X j , h = ^y j X j . 
1 1 

It seems reasonable to introduce a short notation for the right side of l|2.1|) . we 

select CH [J2i XjXj,Y^,i VjXj] or CH [ x > v] (if the frame is obvious). 

Let S be a set and let be defined an operation G : S — ► S 1 of G on 5. If we fix a 
point s £ S then the set of elements G s = {<? 6 G | <?(s) = s} obviously forms the 
isotropy (sub)group of s in G 39, § 1.5]. There is an equivalence relation on S, say, 
si ~ S2 3^ € G : <?si = S2, with respect to which S" is a disjoint union of distinct 
orbits |39l § 1.5]. Thus from now on, without lost of a generality, we assume that 
the operation of G on S is transitive, i. e. for every s £ S we have 

G.s:= |J = & 
sec 

If G is a Lie group then the homogeneous space G/G s is also a Lie group for every 
s G S. Therefore the one-to-one mapping G/G s — > S : g i— > g(s) induces a structure 
of G°°-manifold on 5. Thus the class C^°(S) of smooth functions with compact 
supports on 5* has the evident definition. 

A smooth measure dv on S is called invariant (the Haar measure) with respect 
to an operation of G on 5 if 

/ f(s)du(s)= [ f(g(s))dv(s), for all g e G, /(s) e C£°(S), 

The Haar measure always exists and is uniquely defined up to a scalar multiplier |52l 
§ 0.2]. An equivalent formulation of (|2.2|l is: G operate on L 2 (S,dv) by unitary 
operators. We will transfer the Haar measure dfi from G to g via the exponential 
map exp : g — > G and will call it as the invariant measure on a Lie algebra g. 

Now we can define an operation of a Lie algebra g in the space C§°(S) induced 
by an operation of G on S. Let leg and /(s) € C§°(S) then 

(2.2) lim ^^ gCT, 

where exp : A i— > e* x is the exponential map exp : g — > G. The value of limit (|2.2|l 
will be denoted by [A/](s). If 5 is equipped by a measure we can define an 
adjoint operation A* of g on L 2 (S 1 dv) by natural formula (f(s),[X*g](s)) := 
([A*/](s),p(s)). The invariance H2.2(l of dv may be reformulated in the terms of 
the Lie algebra g as follows: 

A* = Xj, 

for every Xj, 1 < j < AT from a frame of g. Summarizing, A : / — > [A/] is a 
selfadjoint (possibly unbounded) operator in L 2 (S,dv) with invariant measure ciiA 
In general, we will speak on an operation of a Lie algebra g on a manifold S 
with a measure dv if there is a linear representation of g by selfadjoint operators 
on the linear space L 2 (S,dv). As usual, if A is selfadjoint on L 2 then e 1 *^ is 
unitary on L 2 . Clearly, every operation of a Lie group on S induces an operation 
of the corresponding Lie algebra, but inverse is not true generally speaking (see 
Exanrole l2.fi[l . Therefore we will based on the notion of a Lie algebra operation. 
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The succeeding object will be useful in our study of convolution algebras repre- 
sentations. We define the kernel of operation of g on S as follows: 

(2.3) Ker ( , S) = {X e g \ [Xf]{x) = for all f(x) e C °°(S)}. 

If an operation of g on S is induced by an operation of G on S then X € Ker (g, S) 
if and only if for e x € G and for any sgSwe have e (s) = s. There is no doubt 
that Ker (g, S) is a two-sided ideal of g (and therefore a linear subspace). Thus we 
can introduce the quotient Lie algebra Ess (g,S) = g/Ker (g, S) (see |33 § 6.2]). 
An induced action of Ess (g, S) on S is evidently specified. 
Now we can describe the main object of the paper. 

Definition 2.1. Let we have a (selfadjoint) operation of a Lie algebra g on S 
(possibly induced by an operation of a Lie group G on a set S) and let {Xj}i<j<N 
be a fixed frame of g. We will define the operator of relative convolution K induced 
by g on E = C^°(S) with a kernel k(x) € C$°(R N ) by the formula 

(2.4) K = (2tt)- n / 2 [ %{x 1 ,X2,...,x N )e i 'Z? x * x i dx, 

where integration is made with respect to an invariant measure on g = WL N . Here 
k(s) is the Fourier transform of the function k(s) over R*: 

k{x) = {2n)- N / 2 [ k(y) e~ lyx dy. 
Jr n 

Remark 2.2. This definition has an origin at the Weyl functional calculus |f>4] (or 
the Weyl quantization procedure), see Example 14.11 for details. Feynman in [T§] 
proposed its extension — the functional calculus of ordered operators — in a very 
similar way. Anderson 1 introduced a generalization of the Weyl calculus for ar- 
bitrary set of self-adjoint operators in a Banach space exactly by formula Q2.4JI . A 
description of different operator calculuses may be found in |4~3* . But it was shown 
by R. Howe |2Ell2iI|> that success of the original Weyl calculus is intimately con- 
nected with the structure of the Heisenberg group and its different representations. 
Thus one can obtain a new fruitful branch in this direction making an assumption, 
that the operators Xj in (|2.4|l are not arbitrary but are connected with some group 
structure. Such a treatment for the Heisenberg group and multipliers may be found 
at the Dynin paper |17| . M. E. Taylor in [S3 introduced "smooth families of con- 
volution operators" , which technically coincide with relative convolutions in many 
important cases. However, full symmetry groups of such smooth families are not 
clear and thus cannot be exploited. Efforts to study simultaneously both the group 
action and operators of multiplication bring also a very similar object at the recent 
paper 2 of Folland [22] ■ But general consideration of relative convolutions seems to 
be new (as well as systematical applications to new and already solved problems, 
see Sections 0] and 0). 

Due to paper J] our definition is correct for any representation of a Lie algebra 
in a Banach space. Thus we can use similar 

Definition 2.3. Let we have a selfadjoint representation of a Lie algebra g on a 
Banach space B and let {Xj}i<j<N be operators represented a fixed frame of g. 



'In the mentioned paper consideration is restricted to nilpotent step 3 Lie algebras. 
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We will define the operator of relative convolution K induced by g on B by the 
formula 

(2.5) K = (2tt)- n/2 f k{x 1 ,x 2 ,... 1 x N )e 1 ^ X ' X J dx. 

JR" 

Here integration is made with respect to an invariant measure on g = K . 

Remark 2.4. As was shown at pQ, formula 1)2.5(1 may be treated as a definition of 
a function k(Xi, X2, ■ ■ ■ , Xn) of operators Xj. See Remark 14.111 for an alternative 
Riesz-likc definition of relative convolutions. 

We have defined relative convolutions only for a very restricted class of kernels 
k{x) and a specific space E. Of course, both of them may be enlarged in the proper 
context. Another interesting modification may be required by a consideration of 
discrete groups and their actions. It may be achieved by a replacing integration 
in l|2.4|) by summation or integration by discrete measures. But in this paper we 
will not consider such cases. 

As we will see, relative convolutions are naturally defined not only for group 
operation on functions domains but also on ranges of function (see Examples 12.61 
IOI and ITl. 

2.2. Basic Examples. The following Examples make clear the relationships be- 
tween the relative convolutions and usual ones. 

Example 2.5. Let G — R N and G operates on S = M. N as a group of Euclidean 
shifts g : y — ► y + g. The algebra g consists of selfadjoint differential operators 
spanned on the frame XJ = \-^p, 1 < j < N '. Then: 

[Kf]{y) = (2n)- N / 2 [ k(x) e Z " f(y) dx 

= (2tt)- JV/2 / k^e' 1 - 1 X3T ^J f(y)dx 

= (2tt)- n ' 2 [ k(x)f(y-x)dx. 

Otherwise, an operator of relative convolution with a kernel k{x) evidently coincides 
with a usual (Euclidean) convolution on R w with the kernel k(x). 

This Example can be obviously generalized for an arbitrary Lie group G and the 
set S = G with the natural left 3 (or right) operation of G on S = G 

G:S^GS (SG) : g' - g^g' (g' - g'g), geG, g'eS = G. 

It is clear, that relative convolutions will coincide with the left (right) group con- 
volutions on G (with, may be, transformed kernels). 

Example 2.6. Let G = M. N with the Lie algebra spanned on operators of multi- 
plication Xj = M yj by yj, 1 < j < N on a space of functions on S = K . Then a 
relative convolution K with a kernel k(x) 

[Kf](y) = (2n)- N / 2 f k(x) e**" f (y) dx 

= k(y)f{y) 

3 For a commutative group G the left and the right operations are the same. 
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is simply an operator of multiplication by k{y). In this case the operation of the 
Lie algebra g on S is not generated by an operation of a Lie group on S. Of course, 
it is possible to establish a connection with Example 12 . 51 through the Fourier trans- 
form, but it is not so simple in other cases. Particularly it will happen when one 
generalizes this Example by use more complicated transformations of range than a 
multiplication by scalars (see Example I4.7|l or simultaneously applies transforma- 
tions from this and the previous Examples (see Example 14. 1(1 . 

Example 2.7. Let H" be the Heisenberg group [13 EH E2] The Heisenberg 
group HP is a step 2 nilpotent Lie group. As a C°° — manifold it coincides with 
K 2 " +1 . If an element of it is given in the form g = (u,v) € HP, where u € K and 
v = (vi, . . . , v n ) G C n , then the group law on HP can be written as 

(2.6) (u, v) * (u 1 , v') = + v! - ilm ^ v' k v k , v x + v [, . . . , v n + v'^j . 

We single out on H™ the group of nonisotropic dilations {S T }, t £ R + : 

S T (u, v) — (t 2 u, tv). 

Functions with the property 

(2-7) (foS T )(g)=r k f(g) 

will be called S T -homogeneous functions of degree k. 

The left and right Haar measure on the Heisenberg group coincides with the 
Lebesgue measure. Let us introduce the right 7r r and the left 7T; regular represen- 
tations of H n on L 2 (H n ): 

(2.8) [n(g)f}(h) = fig-^h), 

(2.9) Mff)/](M - f(h*g). 

Thereafter, G — H™ x H", S = I" and an operation of G on S is defined by the 
two-sided shift 

G : s -> g± 1 * s * 52 , s e S = HP, (g u g 2 ) e G = H" x H". 

The Lie algebra of G is the direct sum g = f) n © t) n of two copies of the Lie algebra 
t)„ of the Heisenberg group W n . If in S = M. N we define Cartesian coordinates 
Vj> 0<j<N = 2n + l, then a frame of g may be written as follows 

Id , rl 1 / d _ d \ „, 1 / d . _ d 



X l , = - — , X=~\- 2 Vj — , X +n = - — +2y j+n — 

i dy % \dyj+n oy J J ^ i \dyj dy 

(2.10) 

1 9 vr 1 / d 9\ vr 1/9 o 8 

X o = — *J = t o + 2 % — , = T — -2y j+n — 

i dy i \dy J+n oy J J ^ i \dyj dy 



(2.H) 

where 1 < j < n. Vector fields X l j, < j < N generate the left shifts (|2.8|l on 
S = H" and XJ, < j < N generate the right ones 12.9|l . X l j (correspondingly 
XJ) satisfy to the famous Heisenberg commutation relation 

(2.12) \X^\X^ = -[*jft,xj W ] = X'U 

and all other commutators being zero. Particulary, all X\ commute with all X%. 
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Vector fields X l and — Xq are different as elements of g, but have coinciding 
operations on functions. It is easy to see, that Ker (g, S) is a linear span of the vector 
X l + X£ and Ess (g, S) = H 2 ™. Now formula with kernel k(x), x e R 4,l+2 

defines the two-sided convolutions studied in |53j : 

[Kf](y) = (2tt)- n [ k(x)j^™*' x ' f(y)dx 



(2ir)- N / fc(x',a;")/(a;'~ 1 *y^")dx'dx" 
(2v)- N / / k(x',x")ir l (x')Tr r (x")dx'dx" f(y). 



Transformation (*) is possible due the commutativity of Xj and X r -, 

Reduction of two-sided convolutions to the usual group ones was done in in 
a way very similar to the present consideration (see Corollary 13. 51) . 

The Heisenberg group here may be substituted by any non-commutative group 
G (for a commutative group the left and the right shifts are the same) and we will 
obtain two-sided convolutions on G. 

These basic Examples form a frame for other ones: the number of examples may 
be increased both by simple compositions of convolutions from Examples I2.5H2.7I 
and by alterations of considered groups. 

3. Basic Properties 

The main purpose of the present introduction to relative convolutions is a sharp 
extension of harmonic analysis applications. Through relative convolutions we can 
transfer the knowledge on Lie groups and their representations to the different oper- 
ator algebras. Properties of relative convolutions themselves are strictly depending 
on a structure of a concrete group. Thus, it seems unlikely that one can say too 
much about them in general. Nevertheless, results collected in this Section establish 
important properties of relative convolutions and will be forceful in the future. 

Ker (g, S) operates on S trivially therefore we are interested to understand the 
effective part of a relative convolution operator. Let m := dim Ker (g, S) > 0. We 
have a decomposition g = Ker (g, S) © Ess (g, S) as linear spaces. Let us introduce 
a frame {Xj}i<j<N of g such that Xj e Ker(g,5),l < j < m and we assume 
that operator Q2.4fl is written through such a frame (it clearly can be obtained by 
a change of variables). Then the following Lemma is evident. 

Lemma 3.1. (Effective decomposition) Operator (|2.4|l of relative convolution is 
equal to an operator of relative convolution generated by the induced operation of 
Ess(g,5) on S with the kernel k'{x") defined by the formula 

(3.1) 9(x") = {2ir)- m / 2 J k(x',x")dx', 

where x' £ R m , x" S R N ~ m . 

The effective decomposition allows us to consider always a basic case of Ker (g, S) = 
0, Ess (g, S) = g. After that the general case may be obtained by the obvious mod- 
ification. 
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Operators of relative convolution clearly form an algebra and we will denote 
by (k 2 * ki)(x) the kernel of composed operator of two relative convolutions with 
kernels k\(x) and k 2 {x). Of course, k 2 * ki ^ fci * k 2 generally speaking. 

Proposition 3.2. (Composition formula) We have 

(3.2) {k 2 *k 1 ){x) = {2n)- N ' 2 ( k 2 (y)k 1 (CR[-y,x])dy, 



where CH [— y, x] = CH [y ,x] is given by 1)2. 

Proof. For kernels fci , k 2 satisfying the Fubini theorem we can change theintegration 
order and obtain formula l|3.2|) : 

K 2 K 1 = (2tt)- n / 2 [ k 2 {y)e 1 ^" *i x i dy x (2n)~ N / 2 f h(z) e^" z t x > dz 



{2ix)- N / fc 2 (y)fc 1 (z)e l ^"»^e 1 ^"^^ dy dz 
Jr n Jr n 

(2tt)- n [ ( k 2 {y)ki{z)e iCn ^yi x i^ z ! x Adydz 



N N 

-N/2 



(27T)-"/' ( 



(2n)- N ^ 2 f kzWHCKi-^X^XjX^dy 



xe 



dx, 



where e 1 ^ 1 XjXj = e 1 ^ 1 w x je l Si z j x j. Making the change of variables we used 
the invariance of the measure on g. □ 

Note, that for an operation g on S = G induced by the operation of G on S 
formula l|3.2(l gives us the usual group convolution on S — G. Thus we can speak 
about a convolution-like calculus of relative convolutions. This remark gives us the 
following important result describing the nature of relative convolution algebras 4 . 

Theorem 3.3. Let q be an algebra Lie operating on a set S and let G be the 
exponential Lie group o/Ess (g, S). Let also 25 be an algebra of relative convolutions 
induced by g on S and let 25 be a group convolution algebra on G. Then & is a 
linear representation of 05. 

Remark 3.4. Due to Theorem 13.31 we can give an alternative definition of a relative 
convolution algebra, namely, an operator algebra 25 is a relative convolution algebra 
induced by a Lie algebra g, if all representations of 25 are subrepresentations of the 
convolution algebra on group Expg. 

Theorem 13.31 is the main tool for applications of harmonic analysis to every 
problem where relative convolutions occur. Particulary, it gives us an easy access 
to many conclusions obtained by direct calculations. Now we illustrate this by 
applications to two-sided convolutions from Example 1 2. 71 

Corollary 3.5. [HE] An algebra of two-sided convolutions on the Heisenberg group 
HP is a representation of the group convolution algebra on H 2n . 



^Relative convolutions obviously include usual group convolutions and, on the other hand, due 
to Theorcm lij.3l thcv may be treated just as representations of group convolutions. Thus they are 
not generalized convolutions but simply relative convolutions. 
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Explicit descriptions of the established representation depend from properties of 
relative convolutions kernels. In the next paper will be shown that for kernels from 
L 1 (R JV x R w ) there is a one-to-one correspondence between representations of two- 
sided convolutions on R N and usual one-sided convolution on the Exp Ess (g x g , K N ) 
(for the Heisenberg group it was calculated in 1301 )■ If kernels have a symmetry 
group then some representations of Exp Ess (g x 0, K^) vanish, see, for example 
case of two-sided convolutions on H™ with homogeneous kernels (|2.7Jl in [23] • 

There is another simple but important corollary of Theorem 13.31 

Corollary 3.6. Let if) : g — > g be an automorphism of Q as a Lie algebra. Let 
^ :©—)■© be a mapping defined by the rule ^ : K i— * <f>(K), where K is a 
relative convolution with a kernel k{x), ty(K) is a relative convolution with the 
kernel k{ipx) J x l 2 i\}(x) and Jtp(x) is the Jacobian of ip at the point x. Then ^ is 
an automorphism of algebra . 

Proof. The key point of the proof is the invariance of Ij3.2|l under \& (the rest is 
almost evident). This invariance follows from a simple change of variables in the 
integral (|2.4jl : 



*[to**a](s) = (27r)- w / 2 / k 2 {y)k l {CR[-y,ij J {x)])J 1 ' 2 il J {x)dy 

= {2n)- N ' 2 ( fc 2 (y)fc 1 (CH[-^(^- 1 (y)),^(a ; )])J 1 / 2 ^(a:)rfy 

JR N 

= {2k)-W [ k^iy^k^CRl-^Mx^J^Wdy 
= {2n)- N ' 2 f fc 2 (^(y'))fei(^(CH[- 2 /' !a; ]))J 1 /V(x) ( ij/ 

- {2ir)- N ' 2 ( k a Mv'))jV i Ml/)kiMCII[- y ',x])) 

xj 1 / 2 ^'*!) J- l ^{y')dy 
= (2n)- N / 2 [ *to(CH HA*]) di/ 

where y' = ip~ 1 {y)i y — ^{y')- Here transform (*) is possible due to the automor- 
phism property of ip- We also employ the identity 

J 1 ' W) </ l7 W * x) J- V(y') - J 1/2 ^x), 

which follows from the chain rule. □ 

Next Lemma evidently follows from Definition 12 . 31 and Theorem 13. 31 

Lemma 3.7. Let an algebra 25 be a representation of an algebra 25 of relative 
convolutions induced by a Lie algebra g. Then 25 is also the algebra of relative 
convolutions induced by g. 

Otherwise, algebras of relative convolutions induced by a Lie algebra g form a 
closed sub-category Q of the category of all operator algebras with morphisms defined 
by representations (up to unitary equivalence) of algebras. The universal repelling 
object of the category Q is the algebra 25 of group convolutions on Expg. 
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Besides a convolution-like calculus, there is another well developed type of cal- 
culus, namely, the calculus of pseudodifferential operators (PDO), which is highly 
useful in analysis. Let us remind, a PDO Op a(a;,£) [23 0H1 E3] with the Weyl 
symbol a(x, £) is defined by the formula: 



It was shown that relative convolutions are PDOs for many types studed before 
(for example, families of convolutions [511 Proposition 1.1] and meta-Heisenbcrg 
group [22]) ■ But PDOs itself are relative convolutions induced by the Heisenberg 
group (see Example I4.1f> . Thus if we consider morphisms at categories of relative 
convolution algebras only up to smooth operators, then we have 5 

Theorem 3.8. The category Q of relative convolution algebras induced by a Lie 
algebra g, dimg = N is (up to smooth operators) a sub-category of the category Ti N 
of relative convolution algebras induced by the Heisenberg group W N . 

Proof. It is well known [511 Proposition 1.1], that group convolutions on Expg arc 
(up to smooth operators, at least) PDOs on and thus the algebra of convolutions 
belongs to Tt N . The rest of the assertion is given by Theorem 13.31 and Lemma T3. 71 



Of course, there is still a huge distance between Theorem 13.81 and the real PDO- 
like calculus of relative convolutions. 

Calculus of PDO is a representation [22] of a group convolution calculus on the 
Heisenberg group (the simplest nilpotent Lie group). Thus Theorem l3 . 81 establishes 
connection between relative convolutions and convolutions on the Heisenberg group. 
Therefore it is not surprising, that for convolutions on nilpotent Lie groups this 
connection has a very simple form (see [351 Theorem 1]). 

4. Applications to Complex and Hypercomplex Analysis 

In this and the next Sections we would like to introduce a series of essential 
Examples, which show possible applications 6 of relative convolutions. Due to the 
wide spectrum of Examples only brief descriptions will be given here. We are going 
to return to these subjects in the future papers in this series after an appropriate 
development of general theory of relative convolutions. 

As was pointed by Hormander in pQ, formula (|2.4[1 is closely connected with a 
partial differential equation with operator coefficients. Thus it is not surprizing, 
that most Examples within this Section are touching some spaces of holomorphic 
functions, which are solutions to corresponding equations. In Example 14.71 this 
connection will be used directly. 

Example 4.1. Let us consider a combination of Examples 12.51 and 12.61 Namely, 
let q has a frame consisting from vector fields 



5 "The Heisenberg group ... is basic to this paper (and much of the rest of the word)" 1291 . 
^"The most interesting aspect of the . . . theory has to do with the application of this machinery 
to concrete examples" 1251 . 



(3.3) 




□ 



(4.1) 




1 < 3 < N, 
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which operate on S = R by the obvious way. Note, that these vector fields have 
exactly the same commutators H2.12(l as left (right) fields from ()2.10JI (or l|2.11|l ) 

l(r) 

if we put X Q — il. Then an operator of relative convolution with the kernel 
k(x,0, x,£ E R w has form (see [52 § 1.3]) 

[Kf](y) = (2n)- N f k(x,Q e i(S * f(y) dx dl; 

JB 2JV 

= (2^/ k£±l,Qe«y-*Kf(x)dxdZ, 
Jr 2N z 

i. e. it exactly defines the Weyl functional calculus (or the Weyl quantization) 
[271 1481 1501 154] . This forms a very important tool for the theory of differential 
equations and quantum mechanics. 

Our definition of relative convolution operators obviously generalizes the Weyl 
functional calculus from the case of the Heisenberg group to an arbitrary expo- 
nential Lie group. A deep investigation of the role of the Heisenberg group (and 
its different representations) at PDO calculus and harmonic analysis on real line 
may be found at [2H1GII]- Unfortunately, usual definitions of PDO symbol classes 
S m destroy the natural symmetry between x and £ and this restricts applications 
of harmonic analysis to the (standard) PDO theory. Particulary, ^'"(R 2 ™) is not 
invariant under all symplectic morphisms of R 2 ™, which are induced by automor- 
phisms of the Heisenberg group (see Corollary 13. 6]l . 

Example 4.2. Now we follow the paper ^2] footsteps but only in the original 
context of complex analysis (see also an elegant survey in 03 Chap. XII]). Let U ra 
be an upper half-space 

n 

U" = {zeC" +1 | Imz n+1 

3+1 

which is a domain of holomorphy of functions of n + 1 complex variables. Its 
boundary 

n 

bV n = {zeC n+1 | Imz n+1 = 5>/} 

3+1 

may be naturally identified with the Heisenberg group H". One can introduce 
the Szego projector R as the orthogonal projection of L 2 (H n ) onto its subspace 
H 2 (H n ) (the Hardy space) of boundary values of holomorphic functions on the upper 
half-space U". Then a Toeplitz operator ^2] on M n with the pre-symbol Q is an 
operator of the form Tq = RQR where Q : L 2 (H™) — * L 2 (M n ) is a pseudodifferential 
operator. Obviously Tq : H 2 (W n ) H 2 (H. n ). The invariance of the tangential 
Cauchy-Riemann equations under right shifts of H" implies that the Szego projector 
can be realized as a (left) convolution operator on H™ [23] (see also Corollarv l5.14|) . 
Thus the algebra of the Toeplitz operators on H n can be naturally imbedded into 
the algebra of (pseudodifferential) operators generated by left group convolutions 
on H" and PDO. 

First, let us consider a case of a pre-symbol Q taken from usual Euclidean con- 
volutions on H™ = M 2n+1 . Left convolutions on 1" are generated by vector fields 
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Xj from H2.1()|l and Euclidean convolutions are induced by fields (see Examplc l2.5|) 

1 d 

XJ = ± — , l<j<N. 

But two frames of vector fields {Xj, Xj} and {Xj, Xj} define just the same action 
on H". Therefore we have an embedding of the Toeplitz operators with Euclidean 
convolution pre-symbols to the algebra of two-sided convolutions on H™ from Ex- 
ample Ell 

If we now allow Q to be a general PDO from Example 14.11 then we should 
consider a joint operation of vector fields Xj, Xj from (|4.1ll and Xj from p. 101) . 
Again one can pass to equivalent frame defined by Xj, Xj, XJ. The algebra of 
relative convolutions defined by the last frame is the algebra of operators generated 
by two-sided convolutions on H n and operators of multiplication by functions, which 
form a meta-Heisenberg group |22| . Such algebras for continuous multipliers were 
studied in [551 153) . 

There is our conclusion 7 : 

Proposition 4.3. The algebra of the Toeplitz operators with PDO pre-symbols is 
naturally imbedded into the algebra of relative convolutions generated by two-sided 
convolutions on H" and operators of multiplication by functions. 

For the first time the algebra of the Toeplitz operators with two-sided convolution 
pre-symbols was studied at [6'6\ . 

We are going to consider another problem from complex analysis. 

Example 4.4. Let L 2 (C™, dfi n ) be a space of all square- integrable functions on C" 
with respect to the Gaussian measure 

d(i n (z) = Tr~ n e~ z ' z dv(z), 

where dv(z) — dxdy is the usual Euclidean volume measure on C™ = R 2 ™. Denote 
by P n the orthogonal Bargmann projector of L 2 (C n , dfi n ) onto the Segal-Bargmann 
or Fock space F 2 (C n ), namely, the subspace of L 2 (C n ,d[i n ) consisting of all entire 
functions. The Fock space F 2 (C n ) was introduced by Fock [23] to give an alternative 
representation of the Hcisenberg group in quantum mechanics. The rigorous theory 
of F 2 (C n ) was developed by Bargmann [2] and Segal @7J. Such a theory is closely 
connected with representations of the Heisenberg group (see also [^ [25] EH]), but 
studies of the Bargmann projector and the associated Toeplitz operators are usually 
based on the Hilbcrt spaces technique 8 . There is a strong reason for this: the 
Bargmann projection P n is not a group convolution for any group. However, it is 
possible to consider P n as a relative convolution. 

Let us consider the group of Euclidean shifts a : z i— > z + a of C". To make 
unitary operators on L 2 (C™, dfi) from the shifts we should multiply by the special 
weight function: 

(4.2) a: f(z)^ f(z + a)e- za - aa / 2 . 

It is obvious, that (|4.2[l defines a unitary representation [22] of the (2n + 1)- 
dimensional Heisenberg group on L 2 (C n , dfi), which preserves the Fock space F 2 (C n ). 

7 This is an answer to the reasonable question of E. Stein: "Does the algebra of two-sided 
convolutions contain at least one interesting operator?" 
8 Or, at least, do not use harmonic analysis directly. 
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Thereafter all operators (|4.2|l should commute with P n . Unitary operators l|4.2|l 
have such infinitesimal generators 



where a = (ai, . . . , a n ),z = (zi, . . . , z n ) G C™ and aj = (a' j: a"),z = {z'j,z") G M 2 . 
This linear space of generators has the frame 

(4-3) < = | -4'" = 7 (;| + .4). 

Operators (|4.3|> still should commute with the Bargmann projector P n and we can 
expect that P n should be a relative convolution with respect to operators 

(«) JCf-i^-^),*"-!^-^). 

which commute with all operators (|4.3H and together with operator 21 form a self- 
adjoint representation of t) n . Indeed, we have 

Proposition 4.5. The Bargmann projector is a relative convolution induced by the 
Weyl-Heisenberg Lie algebra t) n , which have an operation on C™ defined by (|4.4p . 
Its kernel b(t, £), t G M, £ G C" is defined by the formula: 

b{t,0 = 2 n+1 ' 2 e- 1 e-^ + ^/ 2 \ 

Proof. One can make an easy exercise with integral transforms: 

[P n f]{z) = (27T)-"- 1 / 2 / / 2 " +1 / 2 e-( t2+1+ «)/ 2 



-1/2 f e ~(t 2 +i+^t) dt r e -Ko/2 e -iz^x?+v *n f( z )d<; 



e -«/a e-iES-^cW-K;'*/") /(*) dC 



-CC/2 Sfc=i(Cj afr+C"af77 CjZj) 

e sv e 3 j f{z)dQ 

-CC/2 -CC/2 C2 _ E fc= i(Cj afr+Cj gfv) , / , , 
e w e ^' e 3 3 f(z)dQ 



e<*-W /(z - C) 
(4.5) = tT™ / e^ 2 "^ /(to) diu, 



where C = (C'> C") G R n x R™, w = 2 — (. Formula l|4.5|) is the well known expression 
for the Bargmann projector □ 

See also Corollary 15.121 for an alternative proof. 

Following to papers [HI El IS] we now consider the Toeplitz operator of the form 
T a = P n a(z)I, where a(z)I is an operator of multiplication by a function a(z). 
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For the previous reasons we can handle them as relative convolutions generated 
by operators xj from 1(4.41) and operators Xj = Zjl. We can easily describe all 
non-zero commutators: 

(4.6) [xf, Xj"] = 2il, [xj', Xj] = il, [Xj", Xj'] = il. 



So they form a (4n+ l)-dimcnsional nilpotent step 2 Lie algebra. Particulary sub 



algebra spanned on the vectors Xj-', Xj" and is isomorphic 9 to our constant 



companion f)„. 

Proposition 4.6. There is a natural embedding of the Toeplitz operator algebra on 
the Fock space into the algebra of relative convolutions induced by the Lie algebra 
with commutation relations 1(4.6(1 . 

We will continue our discussion of Toeplitz operators on an "abstract nonsense" 29 
level at Section [5] 

Example 4.7. Let now Xj be generators of the Clifford algebra d(0)n (we use 
book |14| as a standard reference within this Example). This means that the 
following anti- commutation relations hold (compare with 12.12(1 ): 

(4.7) {X, X ) := XX, + XjXi = -2%X , 

where Xq = I. Function / : M. n — > C£(0)n is called monogenic if it satisfies the 
Dirac equation 

mv) v n „ v mv) 



(4.8) D/:= ^_Vx j ^=0 or^.Vl 
9yo ^ ' dyj dy ^ 



The success of Clifford analysis is mainly explained because the Dirac operator ((4.811 
factorizes the Laplace operator A = -j^. 

Hormander's remark from paper gives us by the fundamental solution to the 
Dirac equation in the form 

K(y) = T^ y e- ly ^=^ x i 



("Simply take the Fourier transform with respect to the spatial variables, and solve 
the equation in j/o" 00)- Otherwise, any solution f(y) to 1(4.8(1 is given by a convo- 
lution of some function f(y) on R n_1 and the fundamental solution K(y). On the 



This explains why "a critical ingredient in our analysis is an averaging operation over the 
Segal-Bargmann representation of the Heisenberg group" |2]. 
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contrary, a convolution K(y) with any function is a solution to (|4.8J) . We have: 
[K*f}(y) = [ K(y-t)f(t)dt 

e -<E"=i(w-%)'7i e -««oE"=i ^ dr}f(t) dt 
e *EJU tm e -iT.?=xVite>x i -v i x a ) dr] f^ dt 
e -iEj=i%-(j/oX 3 - w x ) /" e iE"=i%% f{t)dtdri 
(4.9) = / e~ l ^ v ^ VoX ^^ Xa) fi-^drj. 



Equation (|4.9|l defines relative convolution (|2.4(l with the kernel f(—y) and the Lie 
algebra of vector fields 

(4.10) {y Xj - yj X ], 1 < j < n. 

Thus, at least formally, any solution to the Dirac equation (|4.8|l can be written as 
a function (see Remark l2.4|) of n — 1 monomials (I4.10H : 

(4-11) f(yo,yi, ...,y n ) = /(yo^i - yiXa,y X 2 - y 2 X Q , ■ ■ ■ ,yoX n - y n X ). 

Another significant remark: if we fix the value yo = in (|4. 1 1|1 we easily obtain: 
f(0,Vi, ■■■,Vn) = f{-yiX ,-y 2 Xo, . . .,-y n X Q ) = f(-yi, -y 2 , ■ ■ -,-y n )- Thus we 
may consider the function f(yo, yi, ■ ■ ■ y n ) of n+ 1 variables as analytical expansion 
for the function f(yi, ...,y n ) of n variables (compare with |41p. 

Using the power series decomposition for the exponent one can see that for- 
mula (|4.9|l defines the permutational (symmetric) product of monomials l|4.10|) . 
The significant role of such monomials and functions generated by them in Clifford 
analysis was recently discovered by Laville |H3] and Malonek |42j . But during our 
consideration we used only the commutation relation [J^X^] = and never used 
the anti-commutation relations l|4.7|) . Thus formula l|4.9l) is true and may be useful 
without Clifford analysis as well. 

Proposition 4.8. Any solution to equation l|4.8l) . where Xj are arbitrary self- 
adjoint operators, is given as arbitrary function of n monomials (|4.10l) by the for- 
mula 1)4.9(1 . 

It is possible also to introduce the notion of the differentiability 02] for solutions 
to (|4.8|l , namely, an increment of any solution to (|4.8J) may be approximated up to 
infinitesimals of the second order by a linear function of monomials 1(4.10(1 . 

Due to physical application we will consider equation 



<" 2) gr<x>4+M)/, 

where Xj are arbitrary self-adjoint operators and M is a bounded operator com- 
muting with all Xj. 

Remark 4.9. Then Xj are generators ((4.7(1 of the Clifford algebra and M = M a 
is an operator of multiplication from the right-hand side by the Clifford number 
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a, differential operator 1)4.12)1 factorizcs the Hclmholtz operator A + Af a 2 . Equa- 
tion 1)4.12)1 is known in quantum mechanics as the Dirac equation for a particle with 
a non-zero rest mass |3J §20], [111 §6.3] and |38) . 

Simple modification of the previous calculations gives us the following result 

Proposition 4.10. Any solution to equation (|4.12J) . where Xj are arbitrary self- 
adjoint operators and M commutes with them, is given by the formula 

e y M f e ~iZ] =1 vAyoX^ yj x )j^ dri ^ 
where f is an arbitrary function on R ra_1 . 

Remark 4.11. Connection between relative convolutions and Clifford analysis is 
two-sided. Not only relative convolutions are helpful in Clifford analysis but also 
Clifford analysis may be used for developing the relative convolution technique. 
Indeed, we have defined a relative convolution as a function of operators Xj rep- 
resenting a Lie algebra q. To do this we have used the Weyl function calculus 
from pQ. Meanwhile, for a pair of self-adjoint operators X\, X 2 the alternative 
Riesz calculus 03 Chap. XI] is given by the formula 

(4.13) f(Xi + iX 2 ) = J /(r)(rJ - (X 1 + ^X 2 ))- 1 dr. 

As shown in , these two calculuses are essentially the same in the case of a pair of 
bounded operators. To extend the Riesz calculus for arbitrary n-tuples of bounded 
operators {Xj} it seems natural to use Clifford analysis (see, for example, [Tl] l 
which is an analogy to one-dimensional complex analysis. Then one can define a 
function of arbitrary rt-tuple of bounded self-adjoint operators {Xj} in such a way 
(compare with 14.131) 1: 

f(X u X 2 , ...,X n ) = J /(ri,r 2 , . . . , T n ) K( n l - X un I -X 2 ,..., Tn I- X n ) dr, 
where K {t\, t%, . . . , r„) is the Cauchy kernel fron the Clifford analysis . 

5. Coherent States 

This Section is a bridge between the previous and the next ones. Here we will 
give a new glance on some constructions of Examples l4.2l and l4.4l We also provide 
a foundation for the further investigation in Sectional 

5.1. General Consideration. Coherent states are a useful tool in quantum the- 
ory and have a lot of essentially different definitions 03]. Particulary, they were 
described by Berezin in 0J El 125) concerning so-called covariant and contravariant 
(or Wick and anti-Wick) symbols of operators (quantization). 

Definition 5.1. They say that the Hilbert space H has a system of coherent states 
{/«},«£ G if for any f £ H 



(5.1) 



(/,/>= / I </,/«} I" d^i. 
Jg 
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This definition does not take in account that within coherent states a group 
structure frequently occurs and is always useful [44] . For example, the original 
consideration of Berezin is connected with the Fock space, where coherent states 
are functions e za -°°/ 2 . The representation of the Heisenberg group on the Fock 
space was exploited in Example 14.41 Another type of coherent states with a group 
structure is given by the vacuum vector and operators of creation and annihilation, 
which represents group Z. Thus we would like to give an alternative definition. 

Definition 5.2. We will say that the Hilbert space H has a system of coherent 
states {f g }, g 6 G if 

(1) There is a representation T : g i— > T g of the group G by unitary operators 
T g on H. 

(2) There is a vector fo € H that for f g = T g fo and arbitrary / € H we have 

(5-2) (/,/)= / |(/,/ s >| 2 dp, 

Jg 

where integration is taken over the Haar measure dp on G. 

Because this construction independently arose in different contexts, vector fo 
has many various names: the vacuum vector, the ground state, the mother wavelet 
etc. Modifications of definition 15.21 for other cases are discussed § 2.1]. Equa- 
tion i|5.2|l implies, that vector fo is a cyclic vector of the representation G on H . 

Lemma 5.3. Let T is a unitary representation of a group G in a Hilbert space 
H. Then there exists such fa € H that equality (|5.2J) holds. Moreover, if the 
representation T is irreducible, then one can take an arbitrary non-zero vector of 
H (up to a scalar factor) as the vacuum vector. 

Proof. Let us fix some Haar measure dp on G. (Different Haar measures are dif- 
ferent on a scalar factor). If the representation T is irreducible, then an arbitrary 
vector / € H is cyclic and we may put fo — c~ x l 2 f , where 

= J G \(f,T g f}\ 2 dp(g) 

(/,/) 

It is easy to verify, that for the fo equality 15. 2|) holds § 2.3]. 

Let now T is an arbitrary representation, then we can decompose [521 § 8.4] it 
onto a direct integral ^3 § 10] of irreducible representations T — J Y T a da on the 
space H = J Y H a da. Again we can take an arbitrary vector / = J Y f a da € 
H = J Y H a da, such that f a are non-zero almost everywhere, and put fo = 
J Y faCa 1 da, where 

= I G \ (U,T g f a ) a \ 2 d/i(g) 

(fa, fa) a 

In view of ||/|| = J Y \\f a \\ da, the proof is complete. □ 
By the way, a polarization of (|5.2|l gives us the equality 

(5.3) (/i,/a>= / (fiJ g )JhJg)d t ,. 

Jg 

Thus we have an isometrical embedding E : H — > L 2 {G, dp) defined by the formula 



(5.4) E:f~ f(g) = </, f g ) = </, T g f Q ) = (T* g f, fo) = (T g -,f, fo) 
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We will consider L 2 (G, dpi) both as a linear space of functions and as an operator 
algebra with respect to the left and right group convolution operations: 

(5.5) \fi*f»]i(h) = f h{9)f2(g- 1 h)d^(g), 

JG 

(5.6) [fi*f2] r (h) = [ h{g)h{hg)dix{g), 

JG 

For a simplicity we will assume, that G is unimodular (the left and the right Haar 
measures on G coincide) and that L 2 (G, dpi) is closed under the group convolution. 
Thus the construction under consideration may be regarded as a natural embedding 
of the linear space H to the operator algebra B(H). 

Let H 2 (G,dpi) C L 2 (G,dfi) will denote the image of H under embedding E. It 
is clear, that H 2 {G,dpi) is a liner subspace of L 2 (G,<i/i), which does not coincide 
with the whole L 2 (G, dpi) in general. One can see, that 

Lemma 5.4. Space H 2 (G,dpi) is invariant under left shifts on G. 

Proof. Indeed, for every f(g) € H 2 (G,dpi) the function 

fih-'g) = (f,T h -i g f ) = {f,T h -iT B f ) = (T h f,T g f ) = [T h f](g) 

also belongs to H 2 (G,dpi). □ 

If P : L 2 (G,dpi) — > H 2 (G,dpi) the orthogonal projector on H 2 (G, dpi), then due 
to Lemma f5. 41 it should commute with all left shifts and thus we get immediately 

Corollary 5.5. Projector P : L 2 (G, dfi) — > H 2 (G,d[i) is a right convolution on G. 

The following Lemma characterizes linear subspaces of L 2 (G, dfi) invariant under 
shifts in the term of convolution algebra L 2 (G,dfi) and seems to be of the separate 
interest. 

Lemma 5.6. A closed linear subspace H of L 2 (G, dpi) is invariant under left (right) 
shifts if and only if H is a left (right) ideal of the right group convolution algebra 
L 2 (G,dpi). 

A closed linear subspace H of L 2 (G, dfi) is invariant under left (right) shifts if 
and only if H is a right (left) ideal of the left group convolution algebra L 2 (G, dfi). 

Proof. Of course we consider only the "right-invariance and right-convolution" case. 
Then the other three cases are analogous. Let H be a closed linear subspace of 
L 2 (G, dpi) invariant under right shifts and k(g) € H. We will show the inclusion 

(5.7) [/ * k] r (h) = [ f(g)k(hg) dpi(g) e H, 

JG 

for any / G L 2 (G,dpi). Indeed, we can treat integral l|5.7|l as a limit of sums 

N 

(5.8) £/G&)*(%)Aj. 

But the last sum is simply a linear combination of vectors k(hgj) € H (by the 
invariance of H) with coefficients f(gj). Therefore sum (|5.8|l belongs to H and this 
is true for integral (|5.7|l by the closeness of H. 
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Otherwise, let H be a right ideal in the group convolution algebra L 2 (G, dfi) and 
let <]>j{g) <E L 2 (G,dfi) be an approximate unit of the algebra ^3 § 13.2], i. e. for 
any / € L 2 (G, dfi) we have 

[<f>j * f]r(h) = / 4> 3 (g)f(hg) dfi(g) -> f(h), when j -> oo. 

JG 

Then for k(g) £ H and for any h' £ G the right convolution 

[#j * k] r (hti) = / <f>j(g)k(hh'g)dn(g)= / </>j(/i' _1 g')k{hg') dfi(g'), g = ft' .9, 

,/G JG 

from the first expression is tensing to k(hh') and from the second one belongs to 
if (as a right ideal). Again the closeness of H implies k(hh') e ii that proves the 
assertion. □ 

Lemma 5.7. (The reproducing property) For any f(g) 6 H 2 (G,dfj.) we have 
(5-9) [f*Mi(g) = /(<?) 

(5.10) [/o*/]r(<?) = /(<?), 

where /o(5) = (fo, T g fo) is the function corresponding to the vacuum vector fo G H. 
Proof. We again check only the left case and this is just a simple calculation: 

if*fo]i(h) = [ f(g)f (g- l h)d^g) 

fid) (fo,T g -i h fo) dfi{g) 
(f,T g fo) (fo,T g -iT h fo) dfi(g) 
(f,Tgfo) (T g fo,T h fo) dfi(g) 



(f, T gfo) (T h fo, Tgfo) dfi(g) 



(*) 



if, T h fo) 
= f(h). 

Here transformation (*) is based on Ij5.3(l and we have used the unitary property 
of the representation T. □ 

The following general Theorem easily follows from the previous Lemmas 

Theorem 5.8. The orthogonal projector P : L 2 (G,d/i) — > H 2 (G,dfj.) is a right 
convolution on G with the kernel fo(g) defined by the vacuum vector. 

To put in the Archimedes-like words, let me a representation of group G on 
H with a cyclic vector fo and I will construct the projector P : L 2 (G,d[i) — > 
H 2 {G,d^)=H. 

Proof. Let P be the operator of right convolution (|5.t)|l with the kernel fo(g). By 
the Lemma 15.41 H 2 (G, dfi) is an invariant linear subspace of L 2 (G, dfi) . Thus by 
Lemma 15.61 it is an ideal under convolution operators. Therefore the convolu- 
tion operator P with the kernel fo(g) from H 2 (G,dfi) has an image belonging to 
H 2 (G,dfi). But by Lemma l5~7lP = I on H 2 (G,dfi), so P 2 = P on L 2 (G,dfi), i. e. 
P is a projector on H 2 (G,dfi). 
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It is easy to see, that fo(g) has the property fo(g) = /o(— <?), thus P* = P, i. e. 
P is orthogonal. It may be shown also in such a manner. Let f(g) E L 2 {G, dfi) be 
orthogonal to all functions from H 2 (G,dn). Particulary f(g) should be orthogonal 
to fo{h~ 1 g) (due to the invariance of H 2 (G, e?/i)) for any h E G. Then P(f) — 
[f * fo]i — and we have shown the orthogonality again. This completes the 
proof. □ 

Remark 5.9. The stated left invariance of H 2 (G, dfi) and the representation of P as 
a right group convolution have a useful tie with differential equations. Really, let 
Xj, j < to be left-invariant vector fields (i. e. left-invariant differential operators) 
on G. If Xjfo = then Xjf = for any / G H. Thus space H 2 (G,dii) may be 
characterized as the space of solutions to the system of equations Xjf = 0, 1 < 
j < m. 

Another connected formulation: we can think of P as of an integral operator 



with the kernel K(h,g) = /o(ff _1 fc) = h{h^g) = (T g f ,T h f ), then kernel K(h,g) 



is an analytic function of h and anti-analytic of g. 

Example 5.10. An important class of applications may be treated as follows. Let 
we have a space of functions defined on a domain il E M™. Let we have also a 
transitive Lie group G of automorphisms of Q. Then we can construct a unitary 
representation T of G on L 2 (Q) by the formula: 



where J g {x) is the Jacobian of the transformation defined by g at the point x. 

If we fix some point Xq E f2 then we can identify the homogeneous space G/G xo 
with f2 (see notation at the beginning of Subsection l2.1|) . Then left-invariant vector 
fields on G may be considered as differential operators on £1 and convolution oper- 
ators on G as integral operators on f2. This is a way giving integral representations 
for analytic functions. 

5.2. Classical Results. We would like to show, how abstract Theorem 15.81 and 
Example I5.1UI are connected with classical results on the Bargmann, Bergman and 
Szego projectors at the Segal-Bargmann (Fock), Bergman and Hardy spaces respec- 
tively. We will start from a trivial example. 

Corollary 5.11. Let {4>j}, — oo < j < oo be an orthonormalized basis of a Hilbert 
space H . Then 



is a reproducing operator, namely, Bf = f for any f E H . 

Proof. We will construct a unitary representation of group Z on H by its action on 
the basis: 



If we equip Z with the invariant discreet measure dfi(k) = 1 and select the vacuum 
vector fo = 4>o, then all coherent states are exactly the basis vectors: fk — 7fc</>o = 
4>k- Equation (|5.3|l turns to be exactly the Plancherel formula 



(5.11) 



T g : f{x) i ^ f(g(x)) J^\x), f(x) E L 2 (Q), g E G, 



DO 



(5.12) 




Tk<t>j = 4>j+k, k E Z. 



oo oo 



(/i,/a)= E (/i»r i /o)</ a ,T i /o>= E (/i>&></2>&> 
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and we have obtained the usual isomorphism of Hilbert spaces H = £ 2 (^) by the 
formula f(k) = (/, fa). Our construction gives 

oo 

f(k) = (Mfa) (f,T j+k f ) 

j=-oo 
oo 

j=—oo 

= UAk). 

Thus operator B is really identical on H . Note, that similar construction may be 
given for a case of not orthonormalized frame. □ 

In spite of simplicity of this construction, it was the (almost) unique tool to 
establish of various projectors (see |461 3.1.4]). Following less trivial Corollaries 
bring us back to Section 0] 

Corollary 5.12. [2] The Bargmann projector on the Segal-Bargmann space has 
the kernel 

(5.13) K(z,w) = e ^ z - w \ 

Proof. Let us define a unitary representation of the Heisenberg group H" on W 1 by 
the formula [S3 § 1.1]: 

g = (t,q,p) : f(x) - T (t ^ p) f(x) = e ^~V2 q x +qP ) f{x _ 

As "vacuum vector" we will select the original vacuum vector fo(x) ~ e~ x I" 2 . Then 
embedding L 2 (R") — > L 2 (W l ) is given by the formula 

7(g) = (f,T g f ) 

= ir- n ^ J f( x ) e -i(*t-V2 q x+ qP ) e -(*-V2 P ) 2 /2 dx 

= e -2 l t-(p 2 + 9 2 )/2 7r -r l /4 f f'-s e -((p+iq) 2 +x 2 )/2+V2(p+tq)x fa 

Jm." 

(5.14) = e -«t-zg/2 n - n /i J f( x ) e -(z 2 +x 2 )/2+^ dx , 

where z = p + iq, g = (t,p,q) = (t,z). Then f(g) belong to L 2 (H. n ,dg). It is 
easy to see, that for every fixed to function f(z) = e zz ^ 2 /(to, z) belongs to the 
Segal-Bargmann space, say, is analytic by z and square-integrable with respect the 
Gaussian measure ir~ n e~ zz . The integral in (|5.14Jl is the well known Bargmann 
transform 0. Then the projector L 2 (M n , dg) — * L 2 (M. n ) is a convolution on the H™ 
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with the kernel 



P(t,q,p) 



(fo,T g f Q ) 



JR™ 

-n/4 A e -x 2 /2-i2t+V2iqx-iqp-x 2 /2+V2px-p 2 fa 



e - l 2i-(p 2 +g 2 )/2 7r -n/4 / e -( x -(p+ig)/V2) 2 fa 



(5.15) 



,n/4 e -i2t-xz/2 



It was shown during the proof of Proposition 14.51 that a convolution with ker- 
nel 1)5. 15|) defines the usual value of the Bargmann projector with kernel (|5.13|l . □ 

Corollary 5.13. |46l 3.1.2] The orthogonal Bergman projector on the space of 
analytic functions on unit ball B £ C™ has the kernel 



where (£, v) = Y)^ Qvj is the scalar product at C n . 

Proof. We will only rewrite material of Chapters 2 and 3 from 0^] using our vo- 
cabulary. The group of biholomorphic automorphisms Aut (B) of the unit ball B 
acts on B transitively. For any <f> S Aut (B) there is a unitary operator associated 
by (|5.11|l and defined by the formula [461 2.2. 6(i)]: 



where ( £ B, a = _1 (O), /(C) € L 2 (M). Operator T from {^Hfll obviously 
preserve the space H 2 (G) of square- integrable holomorphic functions on B. The 
homogeneous space Aut (B) / Go may be identified with B [13 2.2.5]. To distinguish 
points of these two sets we will denote points of B — Aut (M)/Gq = B by Roman 
letters (like a, u, z) and points of B itself by Greek letters (a, v, C correspondingly). 
We also always assume, that a ~ a,u = v, z = Q under the mentioned identification. 

We select the function /o(C) = 1 as the vacuum vector. The mean value for- 
mula 3.1.1(2)] gives us: 



K((,v) = (l-((,v)) 



-n-l 




n+1 



(5.16) 



/(«) 



(/(OWo) 

(7W(C),/o) 



(5.17) 
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where a = a = </>(0), <j> G B and /(a) € L 2 {B). Particulary 

7o(o) = (v/i-H 2 )" +1 , 



(5.18) /oM 



, n+l 

'1-IClVi-H 2 



(«,0 

An invariant measure on J3 is given |46l 2.2.6(2)] by the expression: 
(5.19) d(i(z) = dv }^ 



(i-icn n+l 

where dv{Q is the usual Lebesgue measure on B = B. We will substitute expres- 
sions from (|5.17|l . I|5.18|) and (|5.19|l to the reproducing formula 

(5.2#x) = f(v)(y/l-\v\ 2 r +1 

f{z)f (z~ 1 u)diJ,(z) 



(*) 



f(z)f [zu) dn{z) 

/(O(Vl-ICI) 



n+l 



/(C) I ^> I Mc) 



(5.21 



Here transformation (*) is possible because every element of B is an involution |46l 
2.2.2(v)]. It immediately follows from the comparison of (|5.2U|I and 1)5. 21|) that: 

f ^= I n / /(C L +1 MO- 
Jm (i - («,C)r + 

The last formula is the integral representation with the Bergman kernel for holo- 
morphic functions on unit ball in C™. □ 

Corollary 5.14. |23) The orthogonal projector Szego on the boundary UV n of the 
upper half-space in C ra+1 has the kernel 



S(z,w) = (-{W n+1 - Zn+i) -^ZjV, , 



Proof. It is well known |23l 1241 14"§] and was described at Example 14. 21 that there is 
a unitary representation of the Heisenberg group H n as the simply transitive acting 
group of shift on bW l (see [H Chap. XII, § 1.4]): 

(5.22) (C, t) : {z', z n+1 ) ^ (z' + £ z n+1 + t + 2% (z', Q + i \(\ 2 ), 

where (£,t) G W\z = {z',z„+i) G C n +1 ,(,z' G C n ,t G M. We again apply 
the general scheme from Example 15.101 This gives an identification of H™ and 
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bi] n and H™ act on bV n = H™ by left group shifts. Left invariant vector fields 
are exactly the tangential Cauchy-Riemann equations for holomorphic functions on 
U™. Shifts l|5.22|) commute with the tangential Cauchy-Riemann equations and thus 
preserve the Hardy space H 2 (bU n ) of boundary values of functions holomorphic on 
U". 

As vacuum vector we select the function fo(z) = (iz n+ i)^ n ^ 1 £ H 2 (bV n ). Then 
the Szego projector P : £ 2 {bV n ) -> H 2 (bU n ) is the right convolution on H™ = bW l 
with fo(z) and thus should have the kernel (see the group low formula (|2.6[) for H") 

n 

S(Z,W) = {-{Wn+l ~ Z n+1 ) - ^ZjWjy 1 - 1 . 

J = l 

Reader may ask, why have we selected such a vacuum vector? The answer is: for 
a simplicity reason. Indeed, the Cayley transform f |49l Chap. XII, § 1.2] and [461 
§2.3]) 

(5.23) C(z) = ^»+ 1+z , e n+1 = (0, ... ,0, 1) e C" +1 

establishes a biholomorphic map from unit ball B £ C ,l+1 to domain U™. We can 
construct an isometrical isomorphism of the Hilbert spaces H 2 (S 2n+1 ) and H 2 (iJ n ) 
based on (|5.23[) 

O-n+l 

(5.24) f(z) ^ [Cf](z) = f(C(z))- / e ff 2 (U"), [C/] € iI 2 (S 2 " +1 ). 

(1 - Z n+ l) n+ ' ! 

Then the vacuum vector /o = (iz„ + i) _ ™ _1 is the image of function fo(w) — 
(—2i/(w — i)) n+2 £ H 2 (S 2n+1 ) under transformation (|5.24H . It seems to be one 
from the simplest functions from iJ 2 (S 2n+1 ) with singularities on S 2n+1 . □ 

5.3. Connections with Relative Convolutions. Now we return to relative con- 
volutions and will show their connections with coherent states. For any operator 
A : L 2 (G,d/j,) — > L 2 (G,d/i) we can construct the Toeplitz-like operator Pa = PA : 
H 2 (G,d[i) — > H 2 (G,dfi). Of course, using the isomorphism H = H 2 (G,d/j,) we 
can think about Pa as an operator Pa ■ H — > H. Particulary, operators of group 
convolution on G will induce relative convolutions on H (see Lemma I3.7|l . Thus 
we again have a direct way for applications of harmonic analysis in every problem 
concerning coherent states. Although, coherent states are very useful in physics we 
will stop here 10 and will only develop this theme in the next Example connected 
with wavelets. 

6. Applications to Physics and Signal Theory 

We are going to consider some Examples connected with physics, but our division 
between mathematics and physics is so fragile as in the real life. 

Example 6.1. Let us consider the u ax + b group" |52l § 7.1] of afhne transforma- 
tions of the real line. We will denote this group by A and its Lie algebra by a. We 
will consider their operation on the real line S = M. a is spanned by two vector 



'However, let us remind again that Example 14. 41 forms an interesting application to physics. 
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fields X s = j-^j (which generate shifts) and Xd — y\-§^ (which generate dilations). 
Their commutators are [.X^-X^] = X s . Then transformation (|5.4|l takes the form 

7{xi,x 2 ) = ^ ! f(y)e^^ +X2X " ) My)dy 

(6.1) = i / I{y)e~^ 2 h{e~ x2 y-x 1 )dy. 

The last line is easily recognized as the wavelet transform j26| . 

Similar expression in the spirit of Definition l5.2l for the Gabor transform 26 may 
be obtained if we replace A by the Heisenberg group H . Then, as was shown early, 
different signal alterations constructed in signal theory are relative convolution on 
S = R induced by H 3 or the meta-Heisenberg group from (22J • For example, 
signal filtration may be presented at the Gabor representation as a multiplication 
by characteristic functions of the wished time and frequency intervals. 

Using relative convolutions we can coherently introduce wavelets-like transform 
for every semi-direct product |221 § 5-3] of Lie group and Abelian one (TJ3- In view 
of applications to the signal theory it seems interesting to start from the Heisenberg 
group and its dilations. The one-parameter group D = {5 T | t e 1} of dilations 
of the Heisenberg group is given by the formula 

(6.2) 5 T (t, z) = (e 2T t, e T z), (t, z) e H n = R x R 2n 
and has the one-dimensional Lie algebra spanned on the vector field 

(6.3) x ^-^4t + 4j- 

If we introduce now the relative convolutions for Lie algebra generated by vector 
fields X l j from H2.10|) and Xh from i|6.3|) then we obtain the Heisenberg Gabor-like 
transform, which should be useful to analyze of the radar ambiguity function [211 
§1-4]. 

Example 6.2. We are going to describe group quantization from paper [57 . The 
usual "quantization" means some (more or less complete) set of rules for the con- 
struction of a quantum algebra from the classical description of a physical system. 
The group quantization is based on the Hamilton description and consists of the 
following steps. 

(1) Let S7 = {xj}, 1 < j < N be a set of physical quantities defining state of a 
classical system. Observables are real valued functions on the states. 

The most known and important case is the set {xj = qj, Xj +n = pj}, 1 < 
j < n, N — 2n of coordinates and impulses of classical particle with n 
degrees of freedom. Observables are real valued functions on R 2n . This 
example will be our main illustration during the present consideration. 

(2) We will complete the set fi till fj by additional quantities xj, N < j < N, 
such that f2 will form the smallest algebra containing SI and closed under 
the Poisson bracket: 

{xj, Xj} £ CI, for all Xj,, Xj £ Si. 

In the case of a particle we should add the function xm+\ — 1, which is 
equal to unit identically and one obtains the famous relations (N = 2n+ 1) 
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(6.4) 




{Xj-\- n , Xj } — ^2n+l 



and all other Poisson brackets are equal to zero. 
(3) We form a iV-dimension Lie algebra p with a frame {%}, 1 < j < N with 
the formal mapping " : Xj <— > 5; j . Commutators of frame vectors of p are 
formally defined throughout the formula 



and we extend the commutator on whole algebra by the linearity. 

For a particle this step give us the Lie algebra \) n of the Heisenberg group 
(compare l|2.12|) and (|6.4|0 . 
(4) We introduce an algebra of relative convolutions l(2.4j) induced by p. 
These operators are observables in the group quantization and by analogy 
to classic case they may be treated as functions of Xj (see Remark 12.4(1 . 
A set S which algebra p acts on and type of kernels are depending on 
physically determining constraints. The family of all one-dimensional rep- 
resentations of *P is called classical mechanics and different noncommuta- 
tive representations correspond to quantum descriptions with the different 
Planck constants. 

For particle we have the following opportunities: 

(a) S = MP, Xj — Xj = M qj , Xj +n — fojif-, relative convolutions are 
PDO from Examplc l4.il and we have obtained the Dirac-Heisenberg- 
Schrddinger-Weyl quantization by PDO. 

(b) S — M. 2n , Xj = Xj = M q . , Xj +n = M pj , relative convolutions are 
operators of multiplication by functions (or just functions) from Ex- 
ample and we have obtained the usual classical description, which 
we have started from. 

(c) S — H™, Xj = Xj , < j < 2n + 1 and relative convolutions 
form the group convolution algebra on H™. This description (so-called 
plain mechanics) contain both the quantum and classical ones with 
the natural realization of the correspondence principle (see |37) for 
details). 

Group quantization is straightforward enough and obviously preserves the sym- 
metry group of the classical system under investigation. Moreover, there is also 
other advantages of the proposed quantization, which distinguish it from the al- 
ready known ones. 

• In contrary to the operator quantization of Berezin 5. and the geometri- 
cal quantization of Kirillov-Souriau-Konstant we should not introduce 
a priori any Planck constants. Moreover, during the posterior analysis of 
relative convolution algebra representations a parameter corresponding to 
the Planck constant will appear naturally. By the way, a set of Planck 
constants should not necessary belong to [0, +00 [ and may form more com- 
plicated topological spaces. 

• The problem of ordering of noncommutative quantities qj and pj does not 
occur under group quantization. Correspondence 



(6.5) 



function k(x) 



convolution with the kernel k(x) 
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is direct enough even for noncommutative groups. Meanwhile, in other 
quantization the "painful question of ordering" |x] has generated many dif- 
ferent answers: the gp-quantization, the pq-quantization, the Weyl-symmetrical, 
the Wick and the anti-Wick (Berezin) quantization. 

Remark 6.3. The presented group quantization has deep roots in the quantization 
procedure of Dirac 15]. The main differences are 

• We recognize the Heisenberg commutation relations 112.120 only as a par- 
ticular case among other possibilities. However, due to Theorem 13.81 thcv 
play the fundamental role. 

• We do not look only for irreducible representations of commutation rela- 
tions. 

7. Conclusion 

The paper tried to illustrate how the systematical usage of harmonic analysis in 
various applications may be useful for both: the analysis and applications. It seems, 
that relative convolutions form an appropriate tool for this purpose. 

Given Examples from different fields of mathematics and physics made reason- 
able studying of relative convolutions. Moreover, we have repeatedly met nilpotent 
Lie groups (and particularly the Heisenberg) group within important applications, 
so our primary interest in such groups should be excused. 
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